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Preamble: Before starting my paper, let me say how delighted I was to 
receive your conference convener's invitation to address this 
conference* It is appropriate for me as national President of the 
Australian Federation of Modern Language Teachers Associations to say 
how pleased the Federation and especially its Council and Executive 
have been in recent years to see closer ties developing between the 
AFMLTA and NZALT. We have also been delighted with the cooperation 
you have offered in connection with the 1988 World Congress to be held 
in Canberra* We thank you for all of that and my being here and the 
alacrity with which I accepted the invitation reflect our desire to 
see the ties between our two organizations strengthened. Since I am 
also the Regional Representative for S.E. Asia and the S.W. Pacific 
for the World Federation of Modern Language Teachers, the Federation 
Internationale des Professeurs de Langues Vivantes, I would also like 
to convey to you the FIPLV's greetings* 

I Introduction : 

Let me outl ine , first, the parameter s within which I have 
prepared my paper. At present, I understand that there are two 
major external examinations in New Zealand, at Third and Fifth 
Years, and that schools award the " Sixth Form Certificate 11 at the 
end of Fourth Year (it is no wonder New Zealanders confuse 
simple-minded Australians at cricket and rugbyl). I also 
understand that the external examinations are norm-referenced, 
that consequently the Fourth Year examinations generally adopt 
similar approaches, but that there is considerable interest in 
moving towards criterion-referenced assessment except that there 
would seem to be some uncertainty about how to relate the 
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concepts of "attainment" , which I take to mean "prof iciency", and 
criterion-referencing to course design. 

Consequently, this paper will consider some basic principles of 

assessment with particular attention to the measurement of 

proficiency , it will outline some principles of syllabus design 

by considering one practical approach to the identification of 

the language content of a syllabus where one regards proficiency 

as the ability to carry out language tasks or to use the language 

for practical purposes; and it will consider just some of the 

implications of different approaches to assessment for syllabus 
CO 

design* (Later I also hope to be able to show a video on the 
measurement of proficiency and, in the workshop, to pose some key 
questions for discussion.) 

The Wider Scene ; 

Little of what this paper will say can be considered novel. Bie 
world trend towards the sort of position that will emerge 
initially became firmly established in the work of the Council of 
Europe* This started to appear more than ten years ago, it 
established the concept of functions and notions in language 
teaching, and its emphasis on language tasks led, in some places, 
to a focus on learners 1 practical ability and, hence, on language 
proficiency • It certainly led, in Britain , to the rapid 
emergence and widespread adoption (not always with secure 
foundations) of graded objectives or graded levels of achievement 
approaches. Though functionalism and related approaches such as 
graded objectives seem to have been taken up somewhat later in 
the United States with little appearing in the literature there 



before the end of the 1970 's, significant work on proficiency and 
its measurement commenced there as early as the 1950 1 s with 
intermittent work that led eventually to the widespread use of 
the Foreign Service Institute (FSI) Scale of "Absolute Language 
Proficiency Ratings" [FSI 1968 and see Clark 1978 for discussions 
of it]* Recently, this scale has been revised and renamed the 
Inter-Agency Language Roundtable (or ILR) Scale. More recently 
again, the concept of proficiency has been related to school and 
university language programmes, and, drawing on both the FSI or 
ILR Scale and the Australian Second Language Proficiency Ratings 
(the ASLPR) , the American Council on the Teaching of Forei gn 
Languages has produced the ACTFL Scale. Now the literature 
coming out of North America is full of proficiency, how to rate 
it, and how to plan and teach proficiency-based courses. 

In Australia, the first major developments of this sort occurred 
in 1978 when work on new national guidelines for the Adult 
Migrant Education Program was commenced. it was in this context 
that Elaine ttylie and the present writer first developed the 
ASLPR though it has subsequently been applied to other languages, 
to other age groups, to school foreign language programmes, and, 
most recently, to special purpose assessment. In 1978, the new 
Ad Migrant Education Program adopted a prof iciency-f ocussed 
approach [see Ingram 1979] and, since then, foreign language 
programmes in all States and Territories have moved to a greater 
or lesser degree towards a proficiency or "competency" focus in 
syllabus design and assessment. Perhaps the most determined 
attempt of this sort and certainly the earliest has been in 
Queensland where the first such syllabuses were prepared in 



1980-31 and are now being revised. It is also undoubtedly 
relevant that, in Queensland, external examinations for most 
Secondary School students were abolished fifteen years ago, a 
system of moderated school-based or internal assessment has been 
operating since then, and considerable responsibility is placed 
on teachers to prepare and assess work programmes using 
syllabuses produced by the Board of Secondary School Studies 
through a complex system of Advisory and Syllabus Committees 
consisting of teachers and academics* 

One further development of considerable potential importance in 
Australia is the nationally-funded Australian Language Levels 
(ALL) Project based in Adelaide and initially directed by the 
Scottish language teacher, John Clark* The ALL Project started 
out as an attempt to produce a set of graded levels of 
achievement specifications or graded objectives for use in 
Australian Secondary Schools* It has become more ambitious and 
perhaps less specific than this and now is attesting to produce 
syllabus guidelines for all languages taught at all levels from 
Year One to Year Twelve in Australian schools* It is indeed an 
ambitious project, well structured tc involve education systems 
in all Australian States and Territories, and, in its theoretical 
developments and practical recommendations , it could have 
implications for the profession beyond Australia. 

This brief sketch of the world scene has been given to show that, 
in moving in the sorts of directions discussed here, New Zealand 
is not alone, indeed it would be adopting interesting, innovative 
but well-established approaches that could, I believe, only 



enhance the practical relevance of its foreign language courses 
and the level of performance of its students. That, at least, 
has been the experience elsewhere, including in my own home State 
of Queensland where the sorts of issues now to be discussed have 
. been basic fodder for the syllabus committees for some five 
years. 

Ill Syllabus Design 

III. 1 Basic Determinants : Though the ultimate focus of this paper is 
on attainment-testing, interpreted here to mean competency or 
proficiency testing, we shall first consider some basic 
characteristics of language and its learning and then some issues 
of syllabus design before focussing on testing. This sequence is 
significant since, if there is one pre-eminent failing with 
external examinations/ it is that they, the tests, come to 
determine what is taught and so become the syllabus. On the 
contrary, though tests can be used to inform syllabus design and 
on-going programme development, ^ - . „ how and what 

you teach must ultimately be determined by the nature of what you 
teach and how it is learned. In other words, the basic 
principles of syllabus design, like the principles of language 
teaching in general, of methodology, and ultimately of testing, 
derive from three basic determinants : the nature of language , 
the nature of the language learner (especially how he learns a 
language), and the nature of the society (especially the 
learner's relationship to the society). Let us look briefly at 
some of their principal characteristics [see Ingram 1978, 
•"Chapters 4-6, or 1979 for fuller discussion]. 
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In considering the nature of language, let us consider what is 
meant when we say someone "knows" a language. First, language is 
rule-based, i.e., a person who knows a language knows the rules 
(e.g., of syntax or vocabulary) on which it operates and can 
apply them in carrying out communication tasks. Because language 
operates on rules, it is , secondly , creative, i.e. the learner 
does not just repeat memorized utterances but he continually 
produces and understands new, original ones. This is important 
to the language teacher since it suggests that one cannot develop 
language proficiency by having the learners rote-memorize 
utterances through "pattern drills", dialogues, or even the 
situational routines into which some graded objectives courses 
readily degenerate. Rather, the learner must internalize the 
basic principles on which the language operates and be able to 
apply them in production or comprehension. Third, language 
varies from context to context, hence, from register to register, 
and so, vhen we say someone knows a language, we mean that he 
knows how to communicate in certain situations. Fourth, it is 
not enough to know rulers and vocabulary, but the person who knows 
a language uses the rules to carry out communication tasks, i.e., 
the learner must learn to mobilize the rules and vocabulary to 
carry out those "language functions" that occur in the situations 
in which he uses the language. Finally, if someone knows a 
language, he does not produce and understand just isolated 
sentences but he is able to tie sentences together, to link them 
into texts, and to relate them to the context, i.e., he knows the 
principles of discourse and cohesion and the features (such as 
pronouns , conjunctions , and inter-sentence connectives like 
"however", "nevertheless" or "the following") that link sentences 



9 



8 



together and relate them to the linguistic and extra-linguistic 
contexts* 

The problem for the syllabus designer is to identify the 
linguistic components that the learner has to know in order to be 
able to use the language. Two factors, in particular, determine 
this: first, the situations in which the learners need to 
operate and, second, the need to develop the language 
systematically so that, in order to meet their needs, learners do 
not just reproduce memorized utterances but use the language 
creatively, as they do their first language. 

The second basic determinant of language teaching, viz* the 
nature of the learner and especially of how he learns the 
language influences the way in which the language content is 
presented and scheduled. It is not possible in this paper to 
discuss fully the "language learning strategies" that emerge as 
one peruses the literature on developmental psycholingui sties 
[but see Ingram 1978, Chapter 4; 1979]. However, they lead to 
principles of methodology that, in brief, can be summarized as: 

1. The learner must be actively and purposefully involved 
at all times. 

2. The learner must have freedom to learn naturally and 
in his own way while being given any formal support he 
needs* 

3. The learner must interact as frequently and naturally 
as possible with speakers of the language. 

4. Language learning occurs in order to satisfy the 
learner's needs and teaching will 'be most effective if 
it responds to the learner's felt needs. 
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The third determinant, the nature of the society and especially 
the learner's relationship to it, raises many important issues 
that lie beyond the scope of this paper [for fuller discussion, 
see Ingram 1978, Chapter 5; 1979]. Suffice it to say that 
society 1 s need for language skills affects the goals that will be 
seen by the learner as relevant and, consequently, how the 
society values language skills affects the learner's motivation • 
In addition, the structure of a society affects the purposes that 
language teaching must satisfy; in a multicultural society, for 
example, where language v .aching has important roles to play in 
culture transmission, in cross-cultural attitude development, and 
in developing communication skills to link cultural groups, the 
purposes language teaching must satisfy are different from those 
in a unilingual society where language teaching might be more 
concerned with skills for international communication, access to 
technology , or general education • Again , if individuals in a 
society are seen as having freedom to direct their own lives or 
to influence the path that the society will take, then it is more 
likely that educational methods will seek to have the learner use 
and develop his own language learning capacities, to try to 
satisfy his own felt needs, and to direct his own learning 
activities* 

The problem for the syllabus designer is to take account of these 
basic determinants, to identify what has to go into the course, 
to organize it for teaching purposes, and to indicate in broad 
terms the teaching and assessment approaches to be adopted. 

III. 2 Identifying Language Content ; Whatever the nature of the course, 
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if it is to systematically develop the learner's language skills, 
it must be coherent and integrated. The first and most 
fundamental need is to clearly establish the course's goals and 
objectives. The goals are the long-term or overall aims of the 
course: whatever else they might envisage, they must include 
precise statements of the nature (e.g. , general or "special 
purpose") and level of proficiency sought. There is no plac.e for 
such "motherhood" statements as "to develop the ability to 
converse freely with native speakers" but they should state the 
desired proficiency goal as, for example, S:1+, L:2, W:1+, R:2 on 
the ASLPR, which, in turn, is translatable into actual 
behavioural descriptions or, in "graded objectives" courses, into 
the range of situations (and their requisite linguistic forms) in 
which the learners are minimally to be able to use the language. 

The objectives are the on-going aims the teacher adopts as he or 
she selects language content to teach and activities for the 
learners to participate in. The objectives are short-term aims, 
especially immediate formal learning aims, which, if viewed 
impartially, are not so much components of language behaviour 
that are being developed as intensive and systematized experience 
that is being given to the learners. Thus, for instance, the 
teacher may choose to present the present continuous tense with 
performance objectives such that, by the end of the lesson, the 
learners will be able to say such utterances as He is closing the 
door or I am reading a book. However, Krashen's distinction 
between learning and acquisition makes it clear that, unless the 
learner is "ready" to acquire that verb form, he is unlikely to 
use that form in a natural situation outside the formal classroom 
except where he can consciously "monitor" his language [see, for 
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operate in the language. Thus, for example, the theme of 
"transport" arising from settings such as "at a street corner", 
"at a bus stop", "at a railway ticket office", and "at an airport 
check-in desk" suggests cultural information such as how crossing 
a city street is regularized, what side of the road cars drive 
on, private and public transport arrangements, road safety 
provisions , and traffic control • Identifying cultural 
information in this way is important for several reasons* First, 
meaning conveyed by' language exists only in the context of the 
culture and, deprived of the culture that is integrated with it, 
language reduces to a meaningless verbal algebra ; second, 
whereas language teaching traditionally neglected the real, 
everyday culture in favour of the atypical literary culture, this 
approach re-emphasizes the general culture; and, third, one needs 
a way of organizing cultural information and integrating it with 
the language teaching so that it can be taught systematically and 
coherently and not become a disjointed list of cultural snippets. 

Assessment and Measurement of Proficiency 

In this paper, the terms "assessment" or "testing" mean the 
considered judgement that teachers make about student learning or 
student performance. "Test" refers to any activity used in 
evaluating or measuring some part or all of a learner's language 
proficiency or other performance [cf. Ingram 1985]. What tests 
or test types are used in the process of assessing language 
learning should depend on the aim of the assessment or testing. 
Thus, if one's interest is in how well the learner has formally 
learned the actual content presented during a course, then tests 
based specifically on that content, i.e., on the syntax, 
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vocabulary or functions specified in the course content , will be 
most appropriate. If the aim of the testing is to measure 
progress in a "graded objectives" course, then the test should 
focus on the situations, tasks, functions, and their exponents 
specified in the course content. If, however, the aim is to 
assess the learner's general proficiency, then a test that gives 
a picture of the learner's practical language skills in general, 
everyday situations will be most appropriate. Proficiency rating 
scales such as the Australian Second Language Proficiency Ratings 
have been developed and seem most suitable for this purpose, 
i.e., to Measure general proficiency. Proficiency is the ability 
to carry out language tasks. In the ASLPR and other rating 
scales, proficiency levels are defined by describing the sorts of 
language tasks learners can carry out and how they are carried 
out in terms of such features as sentence forms , vocabulary 
range , formal accuracy , pronunciation , fluency , comprehen- 
sibility, rate of utterance, register flexibility, and so on. In 
using rating scales to measure proficiency, one essentially asks 
what tasks the learners can carry out, how they carry them out, 
and, most of all, what the nature of the language behaviour 
observed is as the learners try to communicate and what 
behavioural description on the scale best matches the observed 
behaviour. Whereas rating scales designed to measure general 
proficiency describe the tasks and how they are carried out in 
general terms, in terms of an overall picture of the language 
behaviour observable at each level as learners attempt to use the 
language to carry out the tasks , in the graded objectives 
approach, the actual tasks and the actual exponents by which they 
are carried out are generally specified in the syllabus. 



One important advantage of rating scales such as the ASLPR over 
other tests is that they are developmental in structure, i.e., 
the progression of behavioural descriptions attempts to reflect 
the way in which a second language develops from zero to 
native-like. Thus the scale is not arbitrary but related to some 
notion of the universal developmental schedule and a learner 1 s 
rating indicates the stage of development he has reached in the 
developmental schedule. This is important for at least three 
reasons. First, the proficiency measurements provided are not 
arbitrary in the sense that a percentage or a score such as 4 on 
a 7-point scale or 495 out of a possible 650 is arbitrary and 
meaningless but, in that they are behavioural and task-oriented, 
they tell the user exactly what the learner is capable of doing 
and, in that they relate to the developmental schedule, the 
behaviour specified exists within a progressive, developmental 
sequence of bahaviours. Second, through the developmental 
schedule, there are changes in all aspects of language behaviour 
(syntax, vocabulary, discourse, functions, and so on) but 
nevertheless certain aspects of language behaviour and hence 
different parameters of change become salient at different 
developmental stages. This is important not least because the 
key parameters of change help the rater to identify where the 
learner's proficiency falls on the scale. Third, because rating 
scales such as the ASLPR are behavioural and developmental, they 
indicate to the syllabus writer what learners at different levels 
can do, what their future directions of development are, and, 
therefore, what is most relevant to include in their course in 
order to maximize their rate of development. 
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So far reference has been made to the measurement of proficiency 
and it has been suggested that a direct test such as a rating 
scale is particularly effective for this purpose. However, there 
are many purposes for which one tests and many test types: what 
test is most appropriate depends on the purpose of the testing. 
Let us now consider briefly the sorts of tests available and what 
they might contribute to syllabus design. 

There are two broad approaches to test development that can be 
identified [see Ingram 1985]: first, the non-developmental 
approach, which views language proficiency more or less 
statically as facility in handling certain language content (a 
linguistic perspective), and, second, a developmental approach. 

Non-developmental tests may select the content to be tested in an 
ad hoc manner, on a linguistic basis, or on a behavioural basis. 
Ad hoc tests use items and techniques chosen largely on the 
intuitions and experience of the examiner and whether or not they 
work. Many discrete-point tests fall into this category, e.g., 
CELT and TOEFL, as do most public examinations. 
Non-developmental tests prepared on a linguistic basis set out 
from a concept of the nature of language or the relevant <fr?m*1n 
of the language which they seek to sample or within which they 
seek to assess the learner's ability to operate. Some tests use 
frequency counts of lexical or structural items to facilitate 
sampling, others sample randomly (e.g. cloze or dictation), while 
others use contrastive linguistics to identify "difficulties" or 
points of interference. Behaviourally-based non-developmental 
tests identify a particular language behaviour or aspect of 
language behaviour to be tested. This might include particular 
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functions, tasks in specified situations (as in " graded 
objectives 91 approaches), or the language skills needed for some 
activity (e.g. , an academic course). 

Developmentally-based tests" derive their justification from the 
psycholinguistic evidence that language development (whether 
first or second language) is not random but systematic with all 
learners seeming to progress through the same stages. Thus, 
developmentally-based tests seek to relate a learner* s 
proficiency to the stage of development he has reached in the 
developmental schedule. Thus, the ASLPR describes learners* 
language behaviour in terms of the sorts of tasks they can carry 
out and how they carry them out as their proficiency develops 
from zero to native-like. 

Hiese two broad approaches to developing tests lead to different 
types of test which are commonly categorized into indirect, 
semi-direct, and direct tests. Viewed as devices to measure 
proficiency, indirect tests essentially test one thing, e.g. 
syntactic knowledge, and try to say something about something 
else, viz. proficiency. This is done, usually, by psychometric, 
norm-referencing procedures in which the results, distributed 
desirably over a normal curve, are categorized in some way into 
proficiency levels. Typical of indirect tests are discrete-point 
tests in which language knowledge and language behaviour are 
analysed into the smallest possible units and knowledge of or 
ability to use these units is assessed. 

Whereas discrete-point tests are analytic and isolate language 
items, in real-life, language items operate together supporting 
each other in meaning and dependent on each other structurally 
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and part of the skill of language use involves being able to put 
all the items together and to comprehend them when received 
together- Consequently, semi-direct tests (also called 
integrative tests), such as cloze or dictation, have sought to 
integrate the language components into a total event and to test 
knowledge of them or ability to use them in that total event • 
Though sucli tests resemble indirect tests in that they sometimes 
seem to be testing discrete items and the scores are processed 
psychometrically similarly to the scores on indirect tests, 
nevertheless, the fact that a total language event is used puts 
these tests closer to real language performance or the 
demonstration of real language proficiency - hence the term 
"semi-direct 11 . Direct tests (which are also "integrative") focus 
on actual language behaviour, are typified by rating scales 
discussed earlier, and provide the most readily interpretable 
statements of learners* language proficiency. 

Having observed, even if cursorily, the different types of tests, 
let us now consider the different information that the different 
types provide to the syllabus designer and to the teacher. 

V Assessment in Syllabus Design 

V* 1 Identifying Language Content ; Indirect, especially, 
discrete-point, tests can provide specific information on the 
items of knowledge or skill that contribute to or are missing 
from the learner* s interlanguage. Thus, for example, a test such 
as the following shows whether the learner knows and can apply 
the rule that you use the conjunction than after a comparative: 
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Example 1 : 



Tick the item that best fills 
the gap . 



Question; 



"How old is Joe? w 

"He's two years older 



his sister 



Mary." 



Answer: 



that [ ] 



as [ ] 



than [ ] 



of [ ] 



This test will not, however, clearly distinguish whether the rule 
is in the learner's conscious/ learned knowledge and so only 
available for use when he has time to monitor or whether it is in 
his acquired knowledge and available for use in real-life 
situations. This, incidentally, accounts for the fact that 
indirect tests correlate at a relatively low and unstable level 
with direct tests of practical proficiency when the former are 
used with foreign language laerners who, unlike second language 
learners, have had little opportunity to apply their knowledge in 
real-life, practical communication [see Ingram 1982, 1982a]. 
from a syllabus design or programme planning point of view, tests 
of this sort most effectively provide diagnostic information on 
the specific items of syntax, pronunciation, vocabulary, 
discourse , or functions that the learner does or does not know 
and which, if not known, the teacher may wish to include at some 
point in the course* In that such tests are based on specific 
items within the multitude of items that make up a language, 
there is a problem of sampling to ensure the syllabus designer or 
programme planner obtains adequate information. 

Semi-direct tests are sometimes claimed to go part of the way 
towards solving this sampling problem because, if properly 
constructed, they are said to randomly sample the language or the 
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domain of interest and they test the learner's ability to handle 
the items integratively within normal language functioning. 
However, the test would need to be very long for one to be 
confident that the language or even one domain in it had been 
adequately sampled. Nevertheless, a cloze may provide some 
indication of areas of need requiring closer investigation and, 
for programme planning purposes, random cloze could well be 
supported by selective cloze focussing on particular features • 
It is particularly useful as a. means of identifying how the 
learner processes language, e.g. on a word-by-word basis, using 
an immediate context; or using the total context, and so it can 
effectively diagnose the learner's facility in using the cohesive 
and discourse features and indicate the relevance of these 
features and the related linguistic processing for the syllabus 
or programme being developed [see Ingram 1982a] • 

"White noise" and interlinear tests can be used similarly to 
cloze though the white noise test allows one to focus on ability 
in listening. Dictation may be used similarly if presented as 
Oiler proposes [1979s Chapter 10] so as the dictated chunks 
exceed immediate memory capacity and introduce a productive or 
creative element into the test. Delivered more slowly and in 
smaller chunks , it may be used to identify phonological needs 
and, in writing, sound-symbol correspondence or spelling needs. 
In addition, Brindley and Singh [1982] base their testing 
procedures on the assumption that a syntactically detailed 
universal developmental schedule has been identified and use 
dictation incorporating specific syntactic items to provide 
detailed information on syntactic needs and, incorrectly, I 
believe, to make a statement about the learner's proficiency. 
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Direct tests such as the ASLPR, based on an overview of language 
proficiency development , contribute in at least three ways to 
syllabus -design or programme development. First, in that certain 
major parameters of change emerge at different stages in the 
scale, the learners' location at any particular point on the 
scale indicates the development trends that cure dominant for them 
and that a course should attempt to encourage. Second, used 
together with a checklist of phonological, syntactic, discourse 
and other items, direct tests may also be used to identify 
specific items of need in the learner's language though it 
requires skilled interviewing to ensure that the learner's 
interlanguage is adequately sampled, ttiird, we noted earlier how 
rating scales enable the precise statement of goals in 
behavioural, i.e. proficiency, terms. 

V.2 Formative and Summatlve Assessment; The contrast made earlier 
between goals and objectives implies a difference (in nature, 
test types and feedback) between the assessment of general 
proficiency and on-going course achievement ( i.e. , between 
summative and formative assessment). If goals are specified in 
terms of general proficiency, then direct instruments such as the 
ASLPR that measure general proficiency are most appropriate and 
should be used at exit-points (i.e., for summative purposes ) • 
However, if the course aims are not the development of general 
proficiency but something else (e.g., to develop knowledge about 
the language, literary appreciation, or translation skills), then 
different tests will be required (e.g., a discrete-point test, 
literary exegesis, or translation) and the feedback into the 
course will be different. It may also be that, in considering 
course attainment, one wants to know to what extent the learner 
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has internalized the content of the course and, if so, then tests 
directly related to that content may be most appropriate. For 
example', -if one wants to know whether the specified grammatical 
content has been mastered, then discrete-point tests of the 
grammar taught may give the most direct information, A 
functional or language task checklist as used in the Lothian 
progress cards and Waystage Tests may be used to assess 
achievement in the skills aspects of the course [see Clark 1982 
and 1982a], 

At intermediate points in a course, it is probably not 
appropriate to use the ASLPR or another test of general 
proficiency because general proficiency changes too slowly 
(especially in unintensive Secondary School foreign language 
programmes) for valid and reliable measurements of general 
proficiency to show much change or for useful information to be 
fed into on-going course development* At intermediate points, 
teachers are probably most interested in formative testing, in 
particular in order to assess what of their formal teaching is 
being learned and, possibly, acquired. What test will be most 
appropriate for this purpose will depend on what information the 
teacher wants to find out, especially in order to feed back into 
the programme planning: if the teacher* s interest is in whether 
or not the learner is internalizing the grammar that is being 
taught , then test items that focus specifically on the 
grammatical rules will be most appropriate (e.g., discrete-point 
tests, selective cloze or selective dictation); if interest is on 
functions, then a role play approach or even an item such as 
"Tell me what you would say in a post office to ask the cost of 
sending a letter to New Zealand" might be used though it should 



be contextualized in a realistic situation with a contextual 
purpose for the transaction to occur as the Lothian progress 
cards and Waystage tests do [see Clark 1982 and 1982a]. 

This distinction between formative and summative assessment and 
between goals and how the proficiency goals are attained puts 
into clearer perspective continuous assess, nt, which is 
sometimes seen as the alternative to external public 
examinations • Clearly, in a language course, the learners 1 
proficiency in Week 1 is different from their proficiency in 
Weeks 15 or 50 and if the course goals entail proficiency and if 
the final assessment is to make a statement about the learners 1 
attainment in terms of that goal, then measures of the learners 1 
proficiency at intermediate points through the course are largely 
irrelevant and an exit-point assessment of some sort is 
essential. Whether it should be internal and school-based or 
external and "Public " depends on other considerations* 

V.3 Translating Proficiency Ratings into School Grades; One of the 
difficulties teachers sometimes have in confronting rating scales 
is to know how to convert proficiency ratings (which can provide 
a profile of proficiency in all four macroskills, e.g., S:1, 
L:1+, R:1, W:1-) into the grades traditionally used in Secondary 
Schools* We have already seen that rating scales provide a ready 
means of setting goals quite precisely. Thus, one might state 
that the goal in a three year unintensive French course (Years 8 
to 10) is the proficiency S:1-, L:1-, W:1-, R:1- or, in Japanese, 
S:1-, L:1-, W:0+, R:0+ and these figures are immediately 
translated in the scale into behavioural descriptions. This 
approach has several benefits* First, it is more likely to be 
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honest and realistic. Second, it forces syllabus writers and 
teachers to think more clearly and realistically about 
appropriate course content and learning activities. Third, if 
the goals seem modest yet realistic in terms of what firm data is 
available on learning rates [e.g., FSI 1973], then this approach 
also forces policy-makers, education administrators, and 
curriculum planners to realize the effect on language teaching 
and learning of the time allocated to language classes. Fourth, 
goals identified in this way continually remind teachers of the 
essential differences referred to earlier between formal learning 
and acquisition, between goals and objectives, and between the 
proficiency levels to be attained in the course and the content 
the teacher needs to present and have the learner practise as the 
data input to the learner's natural acquisition processes [cf. 
Ingram 1982; Sections III. 1 and III. 2]. Finally, this approach 
readily enables proficiency statements to be converted into 
whatever grades (e.g., words, numbers, or letters) an education 
system cho^as to use. Thus, if goals are speciified in terms of 
the proficiency levels the average student could be expected to 
achieve, then achievement above or below this leads to higher or 
lower grades. For example, the present writer's recommendations 
to the Queensland Board of Secondary School Studies on the 
conversion of goals and proficiency levels to Board grades in the 
unintensive Queensland Secondary School French courses were as in 
Tables 2 and 3. 

V.4 Tests as Syllabuses : Though proficiency descriptions and rating 
scales can be used to specify goals in a language course, neither 
they nor any tests should be used as syllabuses. This is the 
great danger in education systems that climax in important 
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the epeclfled situations. Sating iq«1m designed to meaaure 
general protlolemoy am inappropriate to thla approaoh beoause 
the eotloa of femoral prof lolenoy and ita development ontail tha 
hiererefcioel development of uttaranoaa and tha natural (nanoa 
ereetlve aad aot rote memo r ised) uaa of language. 

However, tha oonoapta of general proflolanoy and gradad 
objectives (oapaoially la Clark's aanaa of "graded lavala of 
achievement" (e.g. , dark 1M2 # iaa2a) ) ara not naoaaaarlly in 
eemfilet provided tha gradad levels of achievement have been 
deal feed to lead ultimately to the development of general 
pretlelemoy. Zm fact, the JtSLPR reoogniiee that formulaic (hence 
rate memo rimed) uttaranoaa are oommon at the 0+ level and even up 
to 1* amd, to thla extent , graded objective* even in the narrow 
a emee may be relevant to the lowest proficiency lavala. From 1-# 
erne cxpeote to erne more flexibility or oreativity atarting to 
emerge amd, beyomd thla level, learners must be able to uae 
oreatlvely whatever leakage reeouroea they have, i.e. to produce 
ami amieretamd orlflmal utteranoea. Qraded levels of achievement 
oomreee beyomd thla level oaa be compatible with general 
prof lo lamo/ bat* to be mo, the situations and the tasks in which 
the lamfaafe la to be taught amd aaaeaaed are more clearly 
opacified than 1m m game r al proflolanoy 11 courses, tha situations, 
tamkm amd language exponents ahould be ao aelected that the 
leaner 9 a developmental needs are taken into account, and the 
lamfaafe eteuld be mo experienced and practiaed that creativity 
la f o eter ed, i.e., the learner la creating language in response 
to altmatloma, porposss amd meanings and not just repeating 
rote ■ memo r lead utterances* So designed , graded objectives 
ee mr eea lead to gamer al proflolanoy and, in them, both tests of 
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the specified situations* Rating scales designed to measure 
general proficiency are inappropriate to this approach because 
the notion of general proficiency and its development entail the 
hierarchical development of utterances and the natural (hence 
creative and not rote-memorized) use of language. 

However, the concepts of general proficiency and graded 
ob j ectives ( especially in Clark* s sense of "graded levels of 
achievement" [e.g. , Clark 1982, 1982a]) are not necessarily in 
conflict provided the graded levels of achievement have been 
designed to lead ultimately to the development of general 
proficiency. In fact, the ASLPR recognizes that formulaic (hence 
rote-memorized) utterances are common at the 0+ level and even up 
to 1- and, to this extent, graded objectives even in the narrow 
sense may be relevant to the lowest proficiency levels. From 1-, 
one expects to see more flexibility or creativity starting to 
emerge and, beyond this level, learners must be able to use 
creatively whatever language resources they have, i.e. to produce 
and understand original utterances. Graded levels of achievement 
courses beyond this level can be compatible with general 
proficiency but, to be so, the situations and the tasks in which 
the language is to be taught and assessed are more clearly 
specified than in "general proficiency" courses, the situations, 
tasks and language exponents should be so selected that the 
learner 1 s developmental needs are taken into account , and the 
language should be so experienced and practised that creativity 
is fostered, i.e., the learner is creating language in response 
to situations, purposes and meanings and not just repeating 
rote-memorized utterances . So designed, graded objectives 
courses lead to general proficiency and, in them, both tests of 
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general proficiency (hence, rating scales such as the ASLPR) and 
the more specific content-oriented tests (e.g., discrete-point 
tests focussing on syntax, functions etc.) are relevant. 

VI Conclusion 

This paper has attempted to show how the concept of proficiency 
can be accommodated in both syllabus design and assessment. It 
tried to present a rational approach to syllabus design in which 
the starting-point is the learners* real needs, the setting of 
r ealistic goals in the light of those needs , and the 
identification of language content that will satisfy the needs 
and also lead to the development of the desired proficiency 
levels. The paper surveyed the major test types and tried to 
demonstrate that there is no single answer to th^ question "how 
to test" but rather different test types serve different 
purposes. If, however, one wants to adopt the development of 
practical proficiency as one of the aims of the course, then one 
must select assessment procedures and test types that enable one 
to measure practical proficiency. At the present stage of 
knowledge in applied linguistics, direct tests, i.e., proficiency 
rating scales, provide the most valid and reliable means of 
measuring practical proficiency and they make a valuable 
contribution to syllabus design. 

Footnote 

1. In this paper, it is necessary to distinguish a "syllabus" or 
"course" (which is time-free) from a "programme" (which is 
sequential and time-governed) • 

2. Throughout this paper, "he" is to be considered common gender. 
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Table 1 Settings, Situations, Roles, Functions and Notions 



SITUATION 



ROLE 



FUNCTIONS 



NOTIONS 



Being interviewed 
by a doctor In his 
surgery 



Patient 



Describing symptoms , 
Seeking information 
about medication , 
etc. 



Pain, 

Intensity, 
Frequency, etc. 



Buying 8 tamp 8 In 
a post office 



Customer 



Seeking Information 
about cost, etc. 



Price, etc. 



Writing up an 
experiment in 
a science 
laboratory 



Teaching 
Assistant 



Describing 
substances, 
Narrating chemical 
events etc. 



Colour, 
Texture, etc. 



Conversing in 
a staff common- 
room 



Staff 
Member 



Greetings, 
Entering a 
conversation, etc. 



Courtesy, etc. 



t that, if a table such as this is to be used as a basis for course design, the following additional 
ms should be added: Syntax, Lexis, Non-Verbals, Other" Linguistic Features, Cultural Knowledge). 
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Table 3. Conversion of Proficiency Ratings to Board Grades, Year 12 



YEAR 12 


GRADES 


PROFICIENCY 


- 




S 


L 


R 


W 


OVERALL 


Very High 
Achievement 

r 


>2 


>2 


>2 


>2 


All four macroskills >2 


High Achievement 


2 


2 


2 


2 


Two or more macroskills 
2, others 1+ 


Sound Achievement 


1+ 


1+ 


1+ 


1+ 


All four macroskills 1+ 


Low Achievement 


1 


1 


1 


1 


One or more macro skill 1 


Very Low 
Achievement 


<1 


<1 


<1 


<1 


Two or more macroskills 

NOTE; Any variation 
below the number of 
macroskills at a 
specified level of 
achievement would have 
to be compensated for by 
an equal number above 
for the learner to be 
graded at that level of 
achievement* 
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Table 2. Conversion of Proficiency Rating 



s to Board Grades, Year 10 



YEAR 10 



GRADES 



Very High 
Achievement 

High Achievement 



Sound Achievement 

Very Low 
Achievement 

Low Achievement 



PROFICIENCY 



R 



W 



Si >1 >1 >l 
1111 

1- 1- 1- 1- 

0+ 0+ 0+ 0+ 

<r 0+ <0+ <0+ <0+ 



OVERALL 



All four macroskills >1 

Two or more macroskills 
l t others 1- 

All four macroskills 1- 



1 or more macroskills 0+ 
Two or more macroskills<0+ 



NOTE : Any variation below 
the number of macroskills 
at a specified level of 
achievement would have to 
be compensated for by an 
equal number above for the 
learner to be graded at 
that level of achievement. 
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